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Abstract: This paper is devoted to a stochastic differential game of functional forward-backward 
stochastic differential equation (FBSDE, for short). The associated upper and lower value functions 
of the stochastic differential game are defined by controlled functional backward stochastic differential 
equations (BSDEs, for short). Applying the Girsanov transformation method introduced by Buckdahn 
and Li pQ, the upper and the lower value functions are shown to be deterministic. We also generalize the 
Hamilton-Jacobi-Bellman-Isaacs (HJBI, for short) equations to the path-dependent ones. By establishing 
the dynamic programming principal (DPP, for short), the upper and the lower value functions are shown 
to be the viscosity solutions of the corresponding upper and the lower path-dependent HJBI equations, 
respectively. 
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1 Introduction 

The theory of backward stochastic differential equations (BSDEs, for short) has been studied widely 
since Pardoux and Peng [T3] first introduced the nonlinear BSDEs in 1990. BSDEs have got applications 
in many fields, such as, stochastic control (see Peng (TT] ) , stochastic differential games (see Hamadene, 
Lepeltier [10], Hamadene, Lepeltier and Peng [TT|), mathematical finance (see El Karoui, Peng and 
Quenez [T3]) and partial differential equation theory (see Peng [T51 [TS]) 5 e * c - 

In the aspect of finance, the BSDE theory presents a simple formulation of stochastic differential 
utilities introduced by Duffie and Epstein [6j. When the generator g of a BSDE does not depend on z, 
the solution Y is just the recursive utility presented in [5J. From the view of BSDE, by studying some 
important properties (such as, comparison theorem) of BSDEs, El Karoui, Peng and Quenez [12] gave 
the more general class of recursive utilities and their properties. And later the recursive optimal control 
problems whose cost functionals are described by the solution of BSDE are studied widely. Peng |19) 
obtained the Bellman's dynamic programming principle (DPP) for this kind of problem and proved the 
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value function to be a viscosity solution of one kind of quasi- linear second order PDE, i.e., Hamilton- 
Jacobi-Bellmaii (HJB) equation. Later, for the recursive optimal control problem introduced by a BSDE 
under Markovian framework, by introducing the notion of backward semigroup of BSDE, in Peng , 
the Bellman's DPP is derived and the value function is proved to be a viscosity solution of a generalized 
HJB equation. 

By now, the DPP with related HJB equation has become a powerful approach to solving optimal 
control and game problems (see [T] [5], [53], [H]). In pQ, Buckdahn and Li studied a recursive stochas- 
tic differential game problem and interpreted the relationship between the controlled system and the 
Hamilton-Jacobi-Bellman-Isaacs (HJBI, for short) equation. A point is worthy to mention: in order to 
derive the DPP, they introduced a Girsanov transformation method to prove the value functions are 
deterministic which is different from the method developed in Peng [20 . 

There really exist some systems which are modeled only by stochastic systems whose evolutions depend 
on the past history of the states. Bases on this phenomenon, Ji and Yang [TB] investigated a controlled 
system governed by a functional forward-backward stochastic differential equation (FBSDE, for short) 
and proved the value function is the viscosity solution of the related path-dependent HJB equation. 

In this paper, inspired by [Tj and [T3J, we will investigate the stochastic differential game problems of 
the functional FBSDEs. Precisely, the dynamics of the stochastic differential games are described by the 
following functional SDE: 

dX™ u < v (s) = b(X2^ u - v ,u(s),v(s))ds + <T(X2^ v ,u(s),v(s))dB(s), s e [t,T], 

(1.1) 

= It- 

And the cost functional J(j t ',u, v) is defined as Y 7t ' u ' v (t) which is the solution of the following functional 
BSDE: 

dYwfs) = -f(X2 t ' u ' v ,Y^' u ' v (s),Z^ u ' v (s), u(s), v(s))ds + Z^ v {s)dB(s), 

(1.2) 

F 7t,u^(T) = $(Xp' u ' v ), se[t,T], 

where 74 is a path on [0,t], The driver / and $ can be interpreted as the running cost and the terminal 
cost, respectively. Also, they depend on the past history of the dynamics. (|1.1[) and (|1.2[) compose a 
decoupled functional FBSDE. The concrete conditions on b, a, /, $ are shown in the later section. 

In the context, we adopt the strategy against control form. The cost functional J (74 ; u, v) is explained 
as a payoff for player I and as a cost for player II. The aim of this paper is to show the following lower 
and upper value functions 

W(-f t ) '■= essinf esssup J(7t; u, /3(u)), (1.3) 
PeBt.T «ew t ,T 

t/(7t) := esssup essinf J(-ft', a(v), v) (1.4) 

aeA t , T v^Vt.T 

are the viscosity solutions of the following path-dependent HJBI equations, respectively: 



and 



D t W(rft) + sup inf H(rf t ,W, D X W, D XX W, u, v) = 0, 
u£U vev 

W(j T ) = $(7t), 7t G A, 



D t U(rtt) + inf sup H{ lu U, D X U, D XX U, u, v) = 0, 



(1.5) 



(1.6) 



U(lt) = $(7t), 7t G A, 
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where 

H(~f t ,y,P,X,u,v) = -tr(<T(T T (j t ,u,v)X) +p.b(j t ,u,v) + f{j t ,y,P-v(jt,u,v),u,v), 

where (jt, U,Pt A") G A x R x R d x § d (E> d denotes the set of d x d symmetric matrices). 

To solve the above stochastic differential game problem, we need the functional Ito calculus and 
path-dependent PDEs which are recently introduced by Dupire [7] (for a recent account of this theory, 
the reader may consult [3J [3J 2]. And under the framework of functional Ito's calculus, for the non- 
Markovian BSDEs, Peng and Wang [22\ derived a nonlinear Feynman-Kac formula for classical solutions 
of path-dependent PDEs. For the further development, the readers may refer to [HI [ST] ). 

In this paper, we apply the Girsanov transformation method in Buckdahn and Li [JJ to prove the 
determinacy of the value functions, which is different from the method introduced by Peng [Jj51 120] . 
Making use of this method and the functional Ito's calculus (introduced by Dupire [7], and developed by 
Cont, Fournie 0[3j[4]), we complete the study of the zero-sum two-player stochastic differential games 
in the non-Markovian case and present the lower and upper value functions of our stochastic differential 
game are the viscosity solution of the corresponding path-dependent HJBI equations, respectively. 

Different from the HJBI equations derived for stochastic delay systems, we establish the dynamic 
programming principle and derive the HJBI equation in the new framework of functional Ito calculus. 

This paper is organized as follows: Section 2 recalls the functional Ito calculus and the well-known 
results of BSDEs we will use later. In Section 3, we formulate our stochastic differential games and get 
the corresponding DPP. Based on the obtained DPP, in Section 4 we derive the main result of the paper: 
the lower and upper value functions are the viscosity solutions of the associated path-dependent HJBI 
equations, respectively. And we add the proof for the DPP in the Appendix. 

2 Preliminaries 

2.1 Functional Ito's calculus 

We present some preliminaries for functional Ito's calculus introduced firstly by Dupire [JJ. Here we 
follow the notations in [7J. 

Let T > be fixed. For each t £ [0, T], we denote A t the set of cadlag functions from [0, t] to M. d . 

For 7 G At, denote 7(s) by the value of 7 at time s £ [0,T]. Thus 7 = (7(s))o<s<t is a cadlag 
process on [0, T] and its value at time s is 7(3). 74 — (7(s))o<s<t G A t is the path of 7 up to time t. We 
denote A = (J A t . For each 74 6 A and x g M. d , 7t(s) is denoted by the value of 74 at s £ [0, t] and 

*6[0,T] 

"ff := (7t(s)o<s<t, 7t(t) + x) which is also an element in A t . 

We now introduce a distance on A. Let (•, •) and | ■ | denote the inner product and norm in M. d . For 
each < t, t < T and 7t,7t £ A, we set 

INI : = sup \lt{s)\, 
se[o,t] 

Il7t-7tlh= sup |7 t (s At) -7f(s At)\, 
se[o,tvt] 

doo(jt,7i) ■= sup \j t (s At) -7f(s At)\ + \t-i\. 
se[o,tvt\ 

It is obvious that A t is a Banach space with respect to |j • ||. Since A is not a linear space, doo is not a 
norm. 
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Definition 2.1. A functional u : A i— > R is A-continuous at 7 t € A, if for any e > £/iere exists 5 > 
smc/i i/iat /or eac/i 7j G A ratt doo(7t,7t) < <5 7 we /law |w(7t) — w(7f)| < £■ 

u is said to be A-continuous if it is A-continuous at each j t £ A. 

Definition 2.2. Let v : A H» M and 74 6 A be given. If there exists p G M. d , such that 

u(7f ) = w(7 t ) + (p, x) + o(\x\), as x ^ 0,x e R d . 

Then we say that v is (vertically) differ entiable at t and denote the gradient of D x v(^t) = P- v is said to 
be vertically differ entiable in A, if D x v(-/ t ) exists for each "ft £ A. The Hessian D xx v(~ft) can be defined 
similarly. It is an S(d)-valued function defined on A, where S(d) is the space of all d x d symmetric 
matrices. 

For each j t 6 A, we denote 7 M (r) := 7t(r)l[ 0jt )(r) + 7t(i)l[ M ] (r), r G [0,s]. It is clear that 7 M G A s . 
Definition 2.3. for a given 74 6 A, z/ we have 

«(7m) = w (7t) + a ( s - *) + °(l s - *D) as s t, s > i, 

£/ien we say i/iai w(7t) is (horizontally) differentiable in t at j t and denote D t v(^t) — a. v is said to be 
horizontally differentiable in A if D t v(-y t ) exists for each j t G A. 

Definition 2.4. Define O'' (A) as i/ie sei of function v := (^(7t))7teA defined on A which are j times 
horizontally and k times vertically differentiable in A such that all these derivatives are A-continuous. 

The following is about the functional Ito's formula which was firstly obtained by Dupire [7] and then 
developed by Cont and Fournie [4J for a more general formulation. 

Theorem 2.1. (Functional Ito's formula). Let (f2, J 7 , {Ft)t£[o,T] , P) be a probability space, if X is a 
continuous semi-martingale and v is in C ' (A), then for any t G [0,T), 

v(X t )-v(X Q )= f D s v(X s )ds+ f D x v(Xs)dX(s) + l f D xx v(X s )d(X)(s), P-a.s. 
Jo Jo ^ Jo 

2.2 BSDEs 

In this section, we recollect some important results which will be used in our stochastic differential 
game problems. 

Let (O, J 7 , P) be the Wiener space, where Vt, is the set of continuous functions from [0, T] to R d starting 
from (fi = C*o([0,T];R rf )), T is the completed Borel cr-algebra over fi, and P is the Wiener measure. 
Let B be the canonical process: B(uj,s) = lj s ,s G [0, T], uj G ft. We denote by F = {J 7 ,, < s < T} 
the natural filtration generated by {B(t)} t >o and augmented by all P-null sets, i.e., F s = a{B(r),r < 
s} V M P , s G [0, T]; = a(B{r) - B(t), t < r < s) V A/>, where M P is the set of all P-null subsets and 
T is a fixed real time horizon. We introduce the following two spaces of processes which will be used 
frequently: 

5 2 (0,T;M") := {(^(*))o<i<T R"-valued F-adapted continuous process : 

e[ sup m)\ 2 \ < +00}; 

0<t<T 

H 2 (0,T;R") :— {(ijj(t))o<t<T R n -valued F-progressively measurable process : 

im! 2 =P[/ T |^)| 2 d*] <+co}. 

Now we consider a function g : f2 x [0, T] x R x M. d — > R, such that (g(t, y, z)) tg [ ,T] is progressively 
measurable for each (y, z) in R x R d , and satisfies the following assumptions throughout the paper: 
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(Al) There exists a constant C > such that, P-a.s., for all t G [0, T], yi,y 2 G R, zi,z 2 € R d , 

|p(t, yi,zi) - g{t,y 2 ,z 2 )\ < C{\y x -y 2 \ + \z\ - z 2 \), 

(A2) 5 (-,0,0) G^ 2 (0,T;R). 

The following results on BSDEs are well-known. The readers may refer to Pardoux and Peng |14| . 

Lemma 2.1. Under the assumptions (Al) and (A2), for any random variable £ G L 2 {Q,, J~t, P), the 
BSDE t 

V{t)=t + J g(s,y(s),z(s))ds- J z(s)dB(s), <t <T (2.1) 

has a unique adapted solution 

(y(t),z(t)) tmT] G <S 2 (0, T; R) x H 2 (0, T; R d ). 
In the following, we always suppose the driving coefficient g of a BSDE satisfies (Al) and (A2). 

Lemma 2.2. (Comparison Theorem) Given two coefficients g\, g 2 satisfying (Al) and (A2) and two 
terminal values £i,£ 2 G L 2 (fl,J 7 T 1 P), we denote by (y ,z ) and (y 2 ,z 2 ) the solution of a BSDE with the 
data and (£ 2 ,g 2 ), respectively. Then we have : 

(i) If £l > 6 and g x > g 2 , P-a.s., then y 1 ^) > y 2 (t), P-a.s., for all t G [0,T]. 

(ii) (Strict monotonicity) If, in addition to (i), we also assume that P(£i > £2) > ; then P(y (t) > 
y 2 (t)) > 0, < t < T, and, in particular, y x (0) > y 2 (0). 

With the notations in Lemma 2.2, we assume that, for some g : Q, x [0, T] x R x R d — > R satisfying 
(Al) and (A2), the drivers gi have the following form: 

g l (s,y l (s),z l (s))=g(s,y l (s),z l (s)) + ip l (s), dsdP-a.e., i = l,2, 

where ipi G % 2 (0, T; R). Then, for all terminal values £1, £2 G L 2 (il, Ft, P), we have the following results. 

Lemma 2.3. The difference of the solutions (y ,z ) and (y 2 ,z 2 ) of BSDE (2.1) with the data (£1,51) 
and (£ 2 ,g 2 ), respectively, satisfies the following estimate: 

\y\t) - y 2 {t)\ 2 + \E[£ e^dyHs) - y 2 (s)\ 2 + \z\s) - z 2 {s)\ 2 )ds \ F t ] 

< E[e^ T ^\^ - 6 1 2 \F] +E[J^e^ s - t )\cp 1 (s) - ^ 2 {s)\ 2 ds \ F t ], 

P-a.s., for allO<t<T, where (3 = 16(1 + C 2 ). 

Proof. For the proof the reader is referred to Proposition 2.1 in El Karoui, Peng, and Quenez or 
Theorem 2.3 in Peng [H]. □ 

3 A DPP for Stochastic Differential Games of functional FBSDEs 

In this section, we consider the stochastic differential games of functional FBSDEs. 

First we introduce the background of stochastic differential games. Suppose that the control state 
spaces U, V are compact metric spaces. U (resp., V) is the control set of all U (resp., F)-valued F- 
progressively measurable processes for the first (resp., second) player. If u € Li (resp., v G V), we call u 
(resp., v) an admissible control. 
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Let us give the following mappings 



b : A x U x V — > E™, 

a : A x U x V — > W ixd , 

f: AxRxR d xUxV — > R. 

For given admissible controls u(-) E U. v(-) E V, and t 6 [0,T], 7 t 6 A, we consider the following 
functional forward-backward stochastic system 

dXW(a) = b(X2^ u - v ,u(s),v(s))ds + cr(X2 t ' u ' v ,u(s),v{s))dB(s), s E [t,T], 
dY^' u ' v (s) = -f(X™ u > v , Y^ u < v (s),Z^ u > v {s),u{s), v(s))ds + Z^ v {s)dB{s), 
= It, 



(3.1) 



Now, we present the assumptions to ensure the existence and uniqueness of the solution of functional 
FBSDEs (|3TT)1 . 

(H) (i) For all t e [0,T], u E U, v E V, x t E A, y E R, z E R d , b(x t ,u,v), a(x t ,u,v), and f(x t ,y, z,u, v) 
are J^-measurable. 

(ii) There exists a constant C > 0, such that, for all t E [0, T], u E U, v E V, for any x\ , x\ E A, 

\b(x\,u,v) -b(x 2 ,u,v)\ < C || x\ -x\ ||; 
|6(a!t,tt,u)| < C(l+ || xt ||), for any x t E A. 

(hi) There exists a constant C > 0, such that for all t G [0, T], u E U, v E V, for any x\,x\ E 
A, y\y 2 E K, z\z 2 e R d 

|/(x t 1 > y 1 s « 1 s u,«) - /(xf, y 2 , *>,<;) | < C(|| x* - x 2 \\ +\y 1 -y 2 \ + \z' - z 2 \); 
|$(a£)-*(a£)| < C \\ x\ - x| ||; 

and 

|/(xi,0,Q,«,t;)|<C(l+ || x t ||); 
|$(x T )| < C(l+ || x T ||), for any x* E A. 

Theorem 3.1. Under the assumption (H), i/iere exists a unique solution (X,Y,Z) E S 2 (0,T;R n ) x 
S 2 (0,T;JR) x H 2 (0,T;R d ) solving ifO) . 

We introduce the subspaces of admissible controls and the definitions of admissible strategies, which 
are similar to pfj. 

Definition 3.1. An admissible control process u = (« r )r£[t,s] (resp., v = (u r )re[i ,s]) f or Player I (resp., 
II) on [t,s] is an J- r -progressively measurable, U (resp., V )-valued process. The set of all admissible 
controls for Player I (resp., II) on [t, s] is denote by Ut. s (resp., Vt, s )- If P{u = u, a.e., in [t,s]} = 1, we 
will identify both processes u and u in Ut,s- Similarly we interpret v = V on [t, s] in Vt, s - 
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Definition 3.2. A nonanticipative strategy for Player I on [t, s] (t < s < T) is a mapping a : Vt, s — > Ltt,s 
such that, for any V-stopping time S : f2 — > [t, s] and any v±,V2 € Vt ;S , with v\ = V2 on [[t,S]], it holds 
that a(vi) = a(v2) on [[t, S]]. Nonanticipative strategies for Player II on [t,s], /3 : Ut. s — > Vt. s , are 
defined similarly. The set of all nonanticipative strategies a : Vt, s — >• Ut,s for Player I on [t, s] is denoted 
by At yS - The set of all nonanticipative strategies f3 : U t ,s — > Vt, s f or Player II on [t, s] is denoted by Bt^ s . 
(Recall that [[t,S]] = {(r,u) £ [0, T] x O, t < r < S(uj).) 

For given processes u(-) € Ut,T, v {') G H,t, initial data t £ [0,T], 7 t £ A, the cost functional is 
defined as follows: 

J( 7t ;u,v):=Y™ u < v (t), 7t £ A, (3.2) 

where the process yw*,* is defined by functional FBSDE (|3TTj) . 

For 7 t G A, we define the lower value function of our stochastic differential games 

W{"ft) '■= essinf esssup J (7*; u, (3(u)), (3.3) 

/3GB t ,T uS Wt,T 



and its upper value function 



J7(7t) := esssup essinf J(-y t ;a(v),v). (3.4) 

aeAt.T v ^Vt,T 



In Ji, Yang [115], they proved the following estimates: 

Lemma 3.1. Under the assumption (H), there exists some constant C > suc/i that, for any t £ 
[0,T], 7t,7teA, u(.)GW, «(-)eV, 

£[ sup \X^(s)\ 2 \F t ] <C(l + || 7t || 2 ), 
«e[t,T] 

£[ sup \X™ v (s) ~ X^(s)\ 2 \T t ] < C\\ lt - 7t || 2 , 
se[t,T] 

E[ sup \Y^(s)\ 2 + jf |^>"'*(s)| 2 ds|.F t ] < C(l + || 7t || 2 ), 
se[t,T] 

E[ sup ^^'"'"(s) - ^""'"(s)! 2 + jf |ZT""'' u (s) - Z^'"»"(s)| 2 ds|J" t ] < C\\j t - 7t|| 2 - 
se[t,T] 

As we known, the essential infimum and essential supremum on a family of random variables are still 
random variables. But by applying the method introduced by Buckdahn and Li [T], we get W( 7 t) and 
U("ft) are deterministic. 

Proposition 3.1. For any t £ [0,T], jt £ A, W("ft) is a deterministic function in the sense that 
W{ lt ) = E[W( lt )], P-a.s. 

Proof. Let H denote the Cameron-Martin space of all absolutely continuous elements h £ £1 whose 
derivative h belongs to L 2 ([0, T];R d ). 

For any h £ H, we define the mapping t^uj := lu + h,ui £ Q. It is easy to check that 77, : Q — > il 
is a bijection, and its law is given by P o [t/j] -1 = exp{J Q T h(s)dB(s) — \ \h(s)\ 2 ds}P. For any fixed 
t £ [0, T], set H t = {h £ H\h(-) = h(- A t)}. The proof can be separated into the following steps: 

(1). For all u £ U t ,T, h e H t , J( 7t ;w, v){r h ) = J(it;u{T h ),v(T h )), P-a.s. 
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First, we make the transformation for the functional SDE: 

XW(a) o (r h ) = ( 7t (t) + J t s b{X^,u{r),v(r))dr + J* cr(X™ u < v , u(r), v(r))dB(r)) o (r h ) 

= 7t(*) + ft b(X^(T h ),u(T h )(r),v(T h )(r))dr 

+ f° a(X^(r h ),u(rh)(r),v(r h )(r))dB(r), 

X*rtTK)rtTK)( a ) = lt{t ) + ^b{Xr u{Th) ' v{Th \u{T h ){r),v{T h ){r))dr 

+ />(X7 tiu(rh) ' ,;(Th) , W (T,)(r), W (r fc )(r)) C /S(r), 

(3.5) 

then, from the uniqueness of the solution of the functional SDE, we get 

X™ u ' v (s){r h ) = X^'< Th ^'< Th \s), for any s G [t,T], P-a.s. 

Similarly, using the transformation to the BSDE in (|3 . 1 [) and comparing the obtained equation with the 
BSDE obtained from p. II) by replacing the transformed control process u(jh) 1 v(rh) for u, v, due to the 
uniqueness of the solution of the functional BSDE, we obtain 

Y^' u ' v (s)(T h ) = Y^'< Th ^ Th \s), for any s G [t,T], P-a.s., 
Z^' u < v (s)(T h ) = Z^' u{ - Th ^ v{ - Th \s), dsdP-a.e. on [0,T] X Q. 

Hence 

J(j t ;u,v)(T h ) = J{"f t \u{T h ),v(T h )), P-a.s. 

(2) . For p G Bt,T, ft G fl*. let /3 h («) := /^(t-^X^), u G U t , T - Then, G B t ,T- 

Obviously, j3 h maps Ut t T into Vt,T- Moreover, this mapping is nonanticipating. Indeed, let S : f2 — > 
[t, T] be an F-stopping time and u±, u-i G Ui.t-, with iti = it 2 on [[t, . Then, obviously, ui(t_/j) = ui(j-h) 
on [[t,5(r_/i)]]. Therefore, 

^(Ui) = ^(r^fa) = /8(u2(r_ h ))(77i) = /^M on [[t,S]]. 

(3) . For any h G H t , and /3 G Bt,r, we have 

{esssup J(7 t ;w, /3(m))}(t /i ) = esssup{ J(-f t ; u, /3(u))(T h )}, P-a.s. 

In fact, for convenience, setting 7(7t; /3) := esssup J(7t; u, /? G $t,x! we have /(7t; /3) > J(jt', u, 0(u)). 

Then I(j t ; (3)(Th) > J(7t; w, /3(m))(t/ 1 ), P-a.s., for all u G Wt.T- Therefore, 

{esssup J(-y t ;u,/3(u))}(r h ) > esssup{ J(-f t ; u, /3(u))(T h )}, P-a.s. 

On the other hand, for any random variable £ which satisfies £ > J(7t; u, /3(u))(r^), we have £(r_h) > 
J(7t;u,/3(u)), P-a.s., for all it G Ut.T- So £(r_ h ) > J( 7t ; P-a.s., i.e. £ > J(7 t ; /?)(r h ), P-a.s. Thus, 

J( 7t ;u, /3(u))(Tfc) > {esssup J (7 t ;u,/3( w))}(Tft,) , P-a.s., for any u £%, 



Therefore, 



esssup{J(7 t ;M,/3(w))(T /l )} > {esssup J(7 t ; it, /3(u))}(r ft ), P-a.s. 
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From above we get 



{esssup J(7 t ;w, (3{u))}{T h ) = esssup{ J{j t ] u, P(u))(T h )}, P-a.s. 

(4). Under the Girsanov transformation r^, W("/t) is invariant, i.e., 

W{ lt )(T h ) = W(7 t ), P-a.s., for any h G JT. 
In fact, similarly to the third step, for all /i G H t , we can prove 

{essinf 7(7 t ;/3)}(r, l ) = essinf {I(7 t ; /3)(r A )}, P-a.s. 
From the first step and the third one, for all h £ H t , we have 

H / (7t)(r/ l ) = {essinf esssup J(7 t ; tt, /3(u))}(r A ), 
0eB t ,T «eW,, T 

= essinf esssup{ J (74 ; u, /3(u)) {th) }, 

PeB t ,T u&At,T 

= essinf esssup{ J(7 t ; u(r h ), /^(ufo)))}, 
0£Bt,T u eu t ,T 

= essinf esssup J(7t; m, /3(m)), 

/3G8t,T u£U t ,T 

= W( lt ), P-a.s. 

In the latter equality we have used {u(r^) | u(-) £ Wf.-r} = Ut.T and | /3 G S*,t} = £>t,T- Therefore, 
for any /i G -fft, W{^it){jh) — W(^t), P-a.s., and since 1^(7*) is J^-measurable, we have this relation for 
all h £ H. 

Combined with the following auxiliary lemma we can complete the proof. 

□ 

Lemma 3.2. Let £ be a random variable defined over our classical Wiener space (J7, .Ft, -P), such that 
C( T /i) = Ci P-a.s., for any h G H. Then £ = P-a.s. 



Proof. Its proof can be found in Buckdahn and Li pQ. 

From the definition of W(^t) and Lemma [6. 11 we have the following property. 
Lemma 3.3. There exists some constant C > such that, for all < t < T, 74,74 G A, 

(i) \W( lt )-W(-f t )\<C\\ lt -j t \\; 

(ii) \W( 7t )\<C(l + \\ lt \\). 



□ 



(3.6) 



Now we adopt Peng's notion of stochastic backward semigroup to discuss a generalized DPP for 
our stochastic differential game (|3.1[) . (|3.3p . The notation of stochastic backward semigroup was first 
introduced by Peng [20] to prove the DPP for stochastic control problems. First we define the family of 
(backward) semigroups associated with FBSDE p.l[) . 

For given initial data 74, a number < 5 < T — t, admissible control processes u(-) G Ut,t+8, v{-) G 
Vt.t+8, we put 

GTjl'sM :=Y^ v (s), se[t,t + S], 
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where r) G L 2 (fi, T* +s , P; R"), {Y^ u - V {s), Z^' u ' v (s)) t < s < t+S is the solution of the following functional 
FBSDE with the time horizon t + 8: 

dY^ u ' v (s) = -f(s, X] t ' u ' v ,Y' 1t '' v " v (s), Z™ u > v (s), u(s), v(s))ds + Z^ v {s)dB(s), 

(3.7) 

Y™ u < v (t + 8) = 77, s G + 5]. 
Also, we have 

G^' V [$(X^ U > V )} = G^ 5 v [Y^ v {t + 8)}. 

Theorem 3.2. Under the assumption (H), the lower value function W(^t) satisfies the following DPP: 
for any 7t G A, 8 > 0, 

W( 7t ) = essinf esssup ^lf (u \w(X^^)}. 

p£Bt,t+s u&A tit +s 

The proof is given in the Appendix. 

4 Viscosity Solutions of Path-dependent HJBI equation 

In this section, we will study the following path-dependent PDE: 

D t W(it)+H-(i t ,W,D x W,D xx W) = 0, 
W{j T ) = $( 7 t), It G A, 



(4.1) 



and 



D t U(rtt) + H+{ lu U, D X U, D XX U) = 0, 
U{it) = Hjt), It g a, 



(4.2) 



where 



H-( lt ,W,D x W,D xx W) = sup inf H( lt ,W,D x W,D xx W,u,v), 

u£U V ^ V 

H+{ lu U, D X U, D XX U) = inf sup H{ lu U, D X U, D XX U, u, v), 

v ^ v uEU 

and 

Hht,y,P,X,u,v) = \tr{aa T (j t ,u,v)X) + p.b(~f t ,u,v) + f(j t ,y,p.a(-y t ,u,v),u,v), 
where ("ft,y,P, X) G A x R x R d x E> d (E> d denotes the set of d x d symmetric matrices). 

We will show that the value function lT( 7 t) (resp., t/( 7 t)) defined in (|3.3[) (resp., (|3.4[) ) is a viscosity 
solution of the corresponding equation (|4.1[) (resp., (|4.2[) ). First we give the definition of viscosity solution 
for this kind of PDEs. For more information on viscosity solution, the reader is referred to Crandall, Ishii 
and Lions [5|. 

Definition 4.1. A real-valued A- continuous function W G C(A) is called 

(i) a viscosity subsolution of equation j4.1\ ) if for any 8 > 0, T 6 C^^A), 7t G A satisfying T > W on 
U A t+S and r( 7i ) = W('j t ) ) we have 

0<s<5 

D t r( 7t ) + h- ( 7t) r, r^r, £> ax r) > o, 



(ii) a viscosity supersolution of equation J^.i| ) if for any 8 > 0, T G (A), 7t G A satisfying T < W 
U A t+;5 and T( 7t ) = W( 7 t), we have 

0<s<5 

D t T(rf t ) + h- ( 7t! r, dj, fl„r) < o, 



on 
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(iii) a viscosity solution of equation if it is both a viscosity sub- and super 'solution of equation 

Theorem 4.1. Under the assumption (H), the lower value function W is a viscosity solution of path- 
dependent HJBI equation on A, the upper value function U is a viscosity solution of h4-2\ ). 

First we prove some auxiliary lemmas. Denote 

F(7 S , y, z, u, v) = D s T(j s ) + \tr(aa 7 \~f s ,u, v)D xx T(j s )) + D x T(j s ).b(j s ,u, v) 
+f(ls, y + r(7 s ), z + D x r(-f s ).a(j s ,u, v),u, v), 

where ( , y s ,y,z,u,v) 6 A x K x R d x U x V. 
Now consider the following BSDE: 



(4.3) 



-dY 1 ' u ' v (s) = F(X™ U > V ) y 1 '«'' u (s), Z 1 - U ' v (s),u(s),v(s))ds - Z 1 ' u ' v (s)dB(s), 
Y l ^ v {t + 8) = 0, s e [t,t + 5]. 
Lemma 4.1. For every s£ [t,t + <5], we have the following relationship: 

y w (s) = G ™[rW+D] -T(X™), P-a. S . 

Proof. Note G^^tT^™^'')] is defined as G 1 s t ^[T(X^' v )] = Y u ' v (s) through the following BSDE 

-dY u > v (s) = f(X2 t ' n ' v ,Y u ' v (s),Z u ' v (s),u(s),v(s))ds - Z u < v {s)dB{s), 
Y^(t + S) = r(X£F v ), ae[t,t + S\. 
By applying Ito's formula to T(X] t ' u ' v ), we have 

d(Y u ' v (s) - T(X'J tiU ' v )) = dY^ u ' v (s), 
combined with Y u > v (t + 6)- T(X™g' v ) = = Y 1 ^^ + 5), we get the desired result. 



□ 



Now we consider the following BSDE: 



-dY 2 ' u ' v (s) = Fh t , Y 2 ' u ' v (s),Z 2 > u ' v (s),u(s),v(s))ds - Z 2 > u ' v (s)dB(s), 

(4.4) 

Y 2 ' u < v (t + S) = 0, s e [t,t + 5]. 
Then, we have the following lemma 
Lemma 4.2. For every u £E U t j+8, v £ Vt,t+s, we have 

\Y l <"> v {t) - Y 2 ' u ' v {t)\ < C6§, P-a.s. 
where C is independent of the control processes u,v and of S > 0. 

Proof. From Lemma 3.2, we have there exists some constant C > such that 

E[ sup |^^( S )| 2 |J- t ]<C(l + || 7 ,|| 2 ), 
se[t,T] 
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combined with 

E[ sup \X^(s)- lt {t)\ 2 \F t ] 
se[t,t+8] 

< 2E[ sup \J f s b(X^ u - v ,u(r),v(r))dr\ 2 \F t ]+2E[ sup f' a(X™ u < v , u(r), v(r))dB(r)\ 2 \ F t ] 

se[t,t+S] s£[t,t+5] 

we have 

E[ sup \X 7t ' u ' v (s) — 7t(*)| 2 |^t] < CS. 

s£[t,t+S] 

From (|4.3I) and (|4.4I) . using Lemma HOI set 

6 = 6 = 0, 5(5, y, = Fix?™, y, z, u s , v.), 
^( s ) = 0, v 2 (s) = F( 7t , r 2 ^( s ), z 2 -^( s ), v .) - w u -", r 2 ^( s ), z 2 -^( s ), u „ «.). 

Denote po(f) = (1 + M 2 ) r , due to b,a,f are Lipishtiz and linear growth, T £ C^' 2 , |ty?2(s)| < /9o(|- 5 Q t; "' 1 ' — 
7t(*)|), we have 

E [f t +s (\Y lM ' v {s) - Y 2 > u ' v (s)\ 2 + iZ^is) - Z 2M ' v {s)\ 2 )ds\F t ] 

< E^ 5 pl{\Xr^ -lt{t)\)ds\F t ] 

< CSE[ sup P 2 (\Xr^ - lt (t)\)\T t ] 

se[t,t+S] 

< CS 2 . 

Therefore, 

|yW(t) - F 2 .«^(t)| = |£;[(y 1 '«."(s) - y 2 ' u ^( s ))|j- f ]| 
= |£[ fi +5 (F(X™*, Y^(s), Z^{a), u(s), v(s)) - F( lt ,Y 2 ^( s ),Z 2 ^( s ),u( S ),v( S )))ds\F t } \ 

< CE[f* +5 [po(\XZf> u > v - 7t |) + {Y^is) - Y 2 > u ' v (s)\ + \Z x ^ v {s) - Z 2 > u > v (s)\]ds\F t ] 

< CE[J* +6 p (\X]^< v - j t \)ds\F t ] + CS?E[f* +S ^^(s) ~ Y 2 ^ v (s)\ 2 ds\F t }i 
+C5?E[f t t+S iZ^is) - Z 2 ' u > v (s)\ 2 ds\T t ]i 

< CSi. 

□ 

Lemma 4.3. Let Yq(-) be the solution of the following ordinary differential equation: 

-dY {s) = Fo{7t,Y (s),0)ds, se [t,t + S], 

(4.5) 

Y (t + S) = 0, 
where the function Fq is defined by 

Fo(jt,y,z) = sup inf F(j u y,z,u,v). 

Then, P-a.s., 

Y (t) = esssup essinf Y 2 ' u ' v (t). 

u£U t ,t+S " eV W+J 
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Proof. First we introduce the function 



Fi(~f t ,y,z,u) = inf F(~f t , y, z, u, v), (j u y,z,u) eAxRxWxU 



and consider the following equation: 



-dY 3 ' u (s) = F 1 ( lt ,Y 3 - u (s),Z 3 ' u {s),u(s))ds- Z 3 ' u (s)dB(s), se[t,t + S], 
Y 3 ' u {t + 5) = 0, 



(4.6) 



according to Lemma \'2. 11 for every u G Ut.t+s, there exists a unique solution (Y 3 ' u , Z 3 ' u ) to (|4.6p . More- 
over, 

Y 3 - U (t) = essinf Y 2 < u > v (t), P-a.s. for every u G W t ,t+«- 

In fact, from the definition of iq and Lemma 12.21 (comparison theorem), we have 

Y 3 ' u (t) < Y 2 ' u ^ v (t), P-a.s. for any v G V t , f+5 ,for every it G W t)i+ *. 

On the other hand, there exists a measurable function v A : R x R d x U —>V such that 

Fi(7 f ,y,z,M) = F(-y t ,y,z,u,v 4 (y,z,u)), for any 

We then put u 4 (s) = v i (Y 3 ' u (s), Z 3 > u (s), u(s)), s G [t,i + <5], and we observe that w 4 G V M+(5 . Conse- 
quently from the uniqueness of the solution of (|4.6|l . it follows that (F 3 ' u , Z 3 -") = (Y 2 ' U >' 1; ji? 2 '"'" ), and in 
particular, Y 3 ' u {t) = Y 2 > u ^ (t) , P-a.s. for every u G W t , t+5 . This proves that F 3 ^(i) = essinf F 2 ' u ' v (t), P-a.s. 
for every u G U t ,t+&- 

Finally, since -Fb(7t: y, z ) — sup iq(7t, y, z, u), by a similar proof we have 

ueu 

Y a (t) = esssup Y 3 ' u (t) = esssup essinf Y 2 ' u ' v (t), P-a.s. 

□ 

Lemma 4.4. For e^ery u G Ut,t+s, v G V{,t+5, we /wwe 

J t+ \\ Y2 ' u ' V (s)\ + \Z 2 ' u ' v {s)\)ds | Ji] < P-a.s., (4.7) 

where the constant C is independent of the control processes u, v and of S > 0. 

Proof. Since F(-j t , •; •; u, v) has a linear growth in (y, z), uniformly in (it, u), we get from Lemma 12.31 for 
some constant C > independent of 6 and the control processes it, u, P-a.s. 

/•t+<5 

\Y 2 ' U - V {s)\ 2 < CS, E[ J \Z 2 ' U - V (r)\ 2 dr \ T s ] < CS. 
On the other hand, from equation (|4.4[) 

\Y 2 ^(s)\ < E[f* +S F('y t ,Y 2 < u > v (r),Z 2 ' u > v (r),u(r),v(r))dr | F a ] 



< CE[f* +S (l + || 7t || 2 + \Y 2 ^(r)\ + \Z 2 ^(r)\)dr \ T s 

< CS + C6^E[f s +S \Z 2 ^ v {r)\ 2 dr | T a ] 

< CS, se[t,t + 5], 
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and applying Ito's formula, we get 



E[J t t+S \Z 2 < u > v (s)\ 2 ds | F t ] < CS 2 , P-a.s. 

Therefore, 

E[f* +s (\Y 2 ' u >"(s)\ + \Z 2 ^{s)\)ds | F t ] 



< C5 2 + C5i{E[fi +S \Z 2 > u > v {s)\ 2 dr \ F t ])i 
C8i P-a.s. 



□ 

Now we are able to finish the proof of Theorem 4.2. 

Proof. (1) First we will prove W(ji) is a viscosity supersolution. Given j t G A, for any S > 0, suppose 
r(7t) = W(7t) and W > T on (J A t+S . 

0<s<5 

Due to the DPP (Theorem IcHZl) . we have 

r(7t) = W( 7t ) = essinf esssup G™/ ^(X™*' )]. 

PtOt.t + 5 ueUt.t + 5 

From W > T on (J A t+S and the monotonicity property of CJ^Zf^l] (see Lemma |2~21 we obtain 

0<s<6 

essinf esssup G^f *> [T(X^^)] - r( 7t ) < 0. (4.8) 



From Lemma 4.1, we have 



Thus, from Lemma T4.21 we get 



essinf esssup Y l > u '^ u \t) < 0, P-a.s. 



essinf esssup Y 2 ' u ^ {u) {t) < C6%, P-a.s. 
Consequently, since essinf Y 2 ' u < v (t) < Y 2 ' u '^(t), f3 6 B tt +s, we get 

esssup essinf Y 2 ' u,v (t) < essinf esssup Y 2 ' u '^ u \t) < C8§, P-a.s. 

Thus, by Lemma T4. 31 Yo(t) < C5i , P-a.s., where Yo(-) is the unique solution of (|4.5[) . Consequently, 

1 1 f* 4 "' 5 

CSi > -Y (t) = - 5 J F (7t,Y (s),0)ds, S > 0, 

sup inf F(7 t ,0,0,u,u) = F (7t,0,0) < 0, 

and from the definition of F we see that W is a viscosity supersolution of (|4.1[) . 
(2) Now we prove W is a viscosity subsolution. 

Given j t G A, for any (5 > 0, suppose r( 7t ) = W(7t) and T > W on (J A t+S . 

0<s<(5 

We must prove that 

sup inf F( 7t , 0, 0, u, v) = F ( 7t , 0, 0) > 0. 
Let us suppose that this is not true. Then there exists some 9 > such that 

F ( 7t , 0, 0) = sup inf F( 7t , 0, 0, u, v) < -6 < 0. (4.9) 
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and we can find a measurable function ip : U — > V such that 

3 

F(j t ,0,0,u, tp(u)) < --0, foralluet/. 

On the other hand, due to the DPP (see Theorem I3.2[) . 

Tim) = Wint) = essinf esssup Q W [lf(^ W )], < S < 6 . 
peB t , t +s ueu t , t +s 

And from W < T on (J A t+S and the monotonicity property of Gff^ff [•] (see Theorem 12 -2[) we 

0<s<S 

obtain 

essinf esssup G™f {u) [T{X^)\ - T( 7t ) > 0, P-a.s., 

PGBt,t+s ueU t}t +s 

Then, similar to (1), from the definition of backward semigroup, we have 

essinf esssup Y 1 '"'^ (t) > 0, P-a.s., 



and, in particular, 



esssup > o, P-a.s. 

ueU t)t+e 



Here, by putting ip s (u)(u>) = -0(u(s)(o;)), (s,u>) £ [t,T] x ft, we identify ip as an element of Bt,t+s- Given 
any e > we can choose u £ € U t ,t+s such that ^."'^("^(i) > — e j. 
From Lemma l4.2l we have 

F 2 '" s ^(" e )(i) > -CSi - eS, P-a.s. (4.10) 

Moreover, from (I4.4[) 

/■t+<5 

Y 2 ' ue '^ vS \t)=E[J F( 7t ,F 2 ^ e ' ,/ '( u£ )(s),Z 2 ^ e ^( uE )(s),u e (s),V(M e (s)))ds|J- f ]. 
we get from (|4.4p 

/•t+cS 

F 2,„=,v(^)( t ) < E [/ (C|y 2 -» e ^( u ")(s)| +C|Z 2 ' tl "^( ue )(s)| +F( 7f ,0,0,w £ (s),V(u £ (s))))ds|J- t ] 



< CP - \Q5, P-a.s. 

(4.11) 

From (|4~T0"]) and (|4~TT|) . -Ctfs - £ < C5i - §0, P-a.s. Letting 5 I 0, and then e 1 0, we get that < 0, 
which induces a contradiction. Therefore, 

sup inf F{n, 0, 0, u, v) = F (<y u 0, 0) < 0, 
ueU vev 

and from the definition of F we see that W is a viscosity supersolution of (|4.1[) . At last, from the above 
two steps, we derive that W is a viscosity solution of (|4.ip . 

The similar argument for U, we also get that U is a viscosity solution of (|4.2p . 

□ 



Appendix: Proof of Theorem 13.21 (DPP) 

Proof. For convenience, we set 

W,(<») = essinf esssup G^f u \wiX%^)]. 

/3£B t ,t+5 u&4 t ,t+S 

We want to prove Wsi"ft) and W(jt) are the same. For it we only need to prove the following three 
lemmas. □ 
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Lemma 4.5. Ws(^ft) is deterministic. 

The proof of this lemma is similar to the proof of Proposition 13. 11 so we omit it here. 
Lemma 4.6. Ws(lt) < W(j t )- 

Proof. Let /3 6 Bt,T be arbitrarily fixed. Then, given a ii2(-) £ Ut+s,T, we define as follows the restriction 
Pi of (3 to U t ,t+s ■ 

/3i(ui) := /3(ui © w 2 )|[t,t+5], wi(-) 6 ^t,i+5, 

where ui © «2 := Uil[ tit+( 5] + W2l(t+5,T]i extends wi(-) to an element of Ut,T- It is easy to check that 
Pi £ 13t,t+8- Moreover, from the nonanticipativity property of f3 we deduce that Pi is independent of the 
special choice of W2G) £ Ut+s,T- Consequently, from the definition of Ws(jt), 

Ws(rf t )< esssup G*$' filM mx?T' PlM )l> P " a - S - 

we use the notation I$(~f t ,u,v) := G^ t ^'g[W(X^g' v )] and notice that there exists a sequence {uj,i > 
1} C Ut,t+s, such that 

IsiluPx) ■= esssup 7 5 (7 t ;ui,ft(wi)) = sup Is{lt)u\ > ft (w-)), P-a.s. 

For any £ > 0, we put f t := {hilu Pi) < h{lt\ uj, j8i(uj)) +e}eJ ( , i > 1. Then r x := Pi, T 4 := f , \ 
i-l ~ 

( U ^0 £ ^"ti * — 2, form an (fi, J r t )-partition, and uf := ^ lr* belongs obviously to Ut.t+s- Moreover, 

i=i »>i 

from the nonanticipativity of /3i we have /?i(wf ) = E ^-TiPi{u\), and from the uniqueness of the solution 

i>i 

of the fully coupled FBSDE with jumps, we deduce that 1,5(74; u\, p\(u\ )) = J2 ^i^s{luu\, P\{u\)), 

i>i 

P-a.s. Hence, 

Wsht)<Ishuf3i) < E lr 1 /«(7t;«J,|9iK 1 )) + e = -f«(7t;«!,j8i («!)) + £ 

4 >! (4.12) 

On the other hand, using the fact that Pi(-) := /?(• © U2) £ Bt.t+s does not depend on U2{) € Ut+s,T^ we 
can define ^2(^2) ■— P{u\ © U2) | [i+<5,T] ) f° r an u 2(0 £ Ut+s,T- Therefore, from the definition of W{^t) we 
have, for any y £ R n , 

W(7t) < esssup J(7 t ;ii2,/3 2 (u 2 ))i P-a.s. 
Finally, because there exists a constant C £ M. such that 

(i) |W(7t) - W(7t)| < C||7t-7t|| for any 7i ,7 t £ A; 

(ii) |J(7t;u2,/82(«2))- J(7t;u2,/9a(«3))| <C|| 7 t-7t||, P-a.s. ( 4 -!3) 
for any u 2 £ U t +s,T- 

We can show by approximating x^g 1 '^ Ul ^ that 

^ AK1 )< esssup J(^' W " ! U 1 AN) 1 P-a-s. 

t»2SWt + 4,T 
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To estimate the right side of the later inequality we note that there exists some sequence {Upj > 1} C 
Ut+s,T such that 

esssup J^^^ua,/^^ ^ P-a.s. 
u 2 eu t+s ,T j>i 

Then, putting A, := { esssup J(X t 7 _^ lK) ; u 2 , fo{u 2 )) < J(X%f ,/3lK) ; u% +e} £ T t+S , j > 

1; we have with Ai := Ai, Aj := Aj \ ( (J A;) 6 j > 2, an (fi, J-t+^-partition and u 2 := 

i=i 

E lAj^j S Ut+s,T- From the nonanticipativity of /3 2 we have f3 2 (u 2 ) — E Ia^Z^C^), and from the 

definition of (3 2 , we know that (3(u\ © u 2 ) — /?i(uf) © (3 2 (u 2 ). Thus, from the uniqueness of the 
solution of functional FBSDE, we get 

J(X%f> Mul) -,u 2 ,p 2 (ul)) = Y x ^ h ^ l) ^^(t + S) 



3>1 



Consequently, 



W , (X ^ AK)) < esgsup J iX M(uf). U2>Mu2)) 

«26Wt + 5,T 

< EiA J ^ t 7 +r I ' ftK) ;«!©^^K©^)) + £ , , 

i>i (4.14) 

= J(X7| ; ; ! AK) ;uf © u§, /3K © ul)) + e 

= J(X^f Mu ^-u^(3(un)+e, P-a.s. 
where u £ :— u\ © u 2 G ^/t,T- From (|4.12p and (14.1411 and the comparison theorem for BSDEs, we have 

< G^ A( " D [J(X^- ftK) ;^,/3(u £ ))] + (C + l)e 

= G^ (ue) [J(^ AK ^«^/3(« £ ))] + (^ + lk 

= J( 7t ;^,/3( U £ ) + (C + l)e 

= y^;" E ^(" e )(t) + (G + i)£, 



(4.15) 



< esssup yr*i«,0(«) (t) + (C + l)e P-a.s. 

Since j3 £ Bt^r has been arbitrarily chosen we have (|4.15[) for all /? £ Bt,T- Therefore, 

Ws{it) < essinf esssup Y™ u >^ u \t) + (C + l)e = VF( 7t ) + (C + l)e. (4.16) 



Finally, letting e | 0, we get W,s(7t) < W(jt)- 
Lemma 4.7. W(7i) < Wg(jt)- 



□ 
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Proof. We continue to use the notations above, and from the definition of Ws("ft) we have 



W 5 ( 7t ) = essinf esssup G^lf^\w(X^ M ^)] 

Pievt.t+s uiew t ,«+« (4 17) 

= essinf IgijuPi), 

Pl6Bt,t+« 

and for some sequence {Pj,i > 1} C Bt,t+s, 

W 5 (7 t ) = MI 5 (j t ,pl), P-a.s. 

For any s > 0, we let fij := {/ 5 (7t, Pi) ~ e < Ws^ft)} € Ft, i > L Hi := fii and n, := fij\( *Q fi,) G 

;=i 

.Ft, i > 2. Then, {IL;, i > 1} is an (fi, ^)-paxtition, Pf := E Ia;^ 1 belongs to Bt.t+s, and from the 

»>i 

uniqueness of the solution of our functional FBSDE, we conclude that 

Ig(j t ,Ui,Pl(ui)) =^2l A Js(7t,u- L ,Pl(u 1 )), P-a.s., 
i>i 

for all ui(-) G U t ,t+s- 

i>l 

> E 1 nj6('yt,ui,Pl(ux)) -e 

i>i (4.18) 

= Is(lt, ui, Pf («i)) -e 

= G? t ^ (u °[W(X7;f A " (ux) )] - Ej P-a.s., for all Ul G W M+ ,. 

On the other hand, from the definition of W{pjt), with the same technique as before, we deduce that, for 
any x G C([0, t + S];R n ), there exists p x > £ G B t +s,T such that 

VF(x t+5 ) > esssup J(a; t+5 ;u 2 ,^ :E ' e (M2)) - £, P-a.s. (4.19) 

Let {Oi}i>i be a Borel partition of C([0,t + <5];R") and diam(Oi) < e, i > 1. Let 7* be an arbitrarily 
fixed element of Oj, i > 1. Defining [X^ 1 '^ 1 ^] := E 7 t l +5 l {x7t ^ 1 ,/3j( Ul)g0 } , we have 



i>l 



^uuPUvi) _ [X^' Pl{ux) ]\ < e, everywhere on Q, for all m £ U t ,t+s- (4.20) 
Moreover, for each 7*, there exists some /3 7 ,e G Bt+s,T such that (I4.19[) holds, and, clearly, := 

E l^-i-flfC-i)^ / 7i ' E 6 Bt+g.T- 

i>l ^ X t + S £ U <i 

Now we can define the new strategy /3 e (u) := pf(ui) © /3J 1 (-«2), « G Wt,T) where Mi = u|[t,t+«]> M 2 = 
U l(t+5,T] (restriction of u to [t, i + 8] x SI and (t + 5, T] x 57, resp.). Obviously, /3 e maps Ut,r into Vt,T- 
Moreover, /3 e is nonanticipating: Indeed, let S : ft — > [t, T] be an F-stopping time and u, u' G be such 
that u = vl on [[t, 5]]. Decomposing u, v! into ui, G Utj+s, u>2i u 2 6 Ut+s,T such that u = ui ffiu^ and 
u = U2©w 2 . We have ui = on [[*, 5A(f+<J)]] from which we get P\ (ui) = Pl(u[) on [[t, S , A(t+<5)]] (recall 
that /3f is nonanticipating). On the other hand, U2 = u' 2 on [[i + 5, S V (t + <5)]](c (t + 5, T] x S > t + 5). 
and on S > t + 6 we have j^^'M 1 '!) _ ^7t;»iA( u J Consequently, from our definition, p^ t = P e u , on 
{S > t + 6} and ^(ua) = P^K) on )]t + S,SV (t + 5)}}. This yields P £ {u) = Pf{m) © P e Ul (u 2 ) = 
Pi(u[) © (u' 2 ) on [[*, 5]], from which it follows that P e £ B u t- 
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Let now u € hit.T be arbitrarily chosen and decomposed into u\ — u\i t< t+s\ G Ut t t+s, and u 2 
u \[t+s,T] G Mt+s,T- Then from (|4.18|) . (|4.13p -fi). (|4.20p and the comparison theorem, we obtain 



> G^'^ (ui) [T^([X t 7 ; ; (5 " 1 ^ ie(Ml) ]) - Ce] - e 

> G^ ( - ) [T^([X t Ttr^ ( - ) ])]-C £ 

= G^ Ae( '' l) [El w T t , 1 , ! <» 1 ) e0 ^(i { )]-^, P-a-s. 
Furthermore, from (14.211) . (|4.13p -fii), (14.1911 and the comparison theorem, we have 

i>l ^ A t + S tUi) 
i>l ^ A t + S tUi) 

> G^^'^^J^f^^^,,^^)) - Ce] Ce 

> G^ ( - ) [J(^r Ae(Ul) ;"2,/3S 1 (« 2 ))] - Ce 
= Gl;lf {u) [Y™^ («) (t + J)] - Ce 

= r™ u >^ u )(t) -Ce, P-a.s., for any u e U t , T - 



Consequently, 



= W(7t)-Ce, P-a.s. 
Finally, letting e | we get Wg^t) > W(j t ). 



(4.21) 



(4.22) 



Ws{"f t ) > esssup J(7 t ;u,/3 e (u)) - Ce 

> essinf esssup J(jt',u, /3(u)) — Ce (4.23) 



□ 



Remark 4.1. (a) (i) For every /3 £ Bt t t+s, there exists some u £ {-) G such that 

W(7t)(= W,( 7t )) < +e, (4-24) 
(ii) There exists some /3 £ (-) £ Bt,t+s such that, for all it(-) £ tit,t+5 

W{ lt ){= W s ( 7t )) > Gl;l S f {u) [W{X^^)] - e, P-a.s. (4.25) 

(b) From Provosition \3.1[ we know the lower value function W is deterministic. So, by choosing S = T — t 
and taking expectation on both sides of \4-24\ l, we get W{^t) = hrf sup E[J(j t ',u, (3(u))}. 

Acknowledgments 

This work was supported by National Natural Science Foundation of China (No. 11171187, No. 
10871118 and No. 10921101); supported by the Programme of Introducing Talents of Discipline to Uni- 
versities of China (No. B12023); supported by Program for New Century Excellent Talents in University 
of China. 



19 



References 



[1] BUCKDAHN, R. and LI, J. (2008) Stochastic differential games and viscosity solution of Hamilton- 
Jacobi- Bellman- Isaacs equation, SIAM J. Control, Optim. 47, 444-475. 

[2] CONT R. and FOURNIE D. A. (2010) A functional extension of the Ito's formula, C. R. Math. 
Acad. Sci. Paris 348, no. 1-2, 57-61. 

[3] CONT R. and FOURNIE D. A. (2010) Change of variables formulas for non-anticipative functionals 
on path space, J. Funct. Anal. 259, no. 4, 1043-1072. 

[4] CONT R. and FOURNIE D. A. (2010) Functional Ito's calculus and stochastic integral representation 
of martingales, arxiv.org/abs/1002.2446. 

[5] CRANDALL, M.G., ISHII, H. and LIONS, P.L. (1992) User's guide to viscosity solutions of second 
order partial differential equations, Bull. Amer. Math. Soc. 27, 1-67. 

[6] DUFFIE D. and Epstein L., (1992) Stochastic differential utility, Econometrica, 60, 3531C 394. 

[7] DUPIRE B., Functional Ito's calculus, Portfolio Research Paper, Bloomberg, 2009. 

[8] EKREN L, KELLER C, TOUZI N. and ZHANG J. (2011) On Viscosity Solutions of Path Dependent 
PDEs, to appear in Annals of Probability (arXiv:1109.5971). 

[9] FLEMING W.H. and METE SONER H., Control Markov processes and Viscosity Solutions, New 
York: Springer Verlag 

[10] HAMADENE S. and LEPELTIER J. P. (1995) Zero-sum stochastic differential games and backward 
equations, Systems Control Lett. 24, 259-263. 

[11] HAMADENE S., LEPELTIER J. P. and PENG, S.G. (1997) BSDEs with continuous coefficients 
and stochastic differential games, Stochastic Differential Equations, Pitman Research Notes in Math. 
Series, No.364, El Karoui Mazliak edit, 115-128. 

[12] El KAROUI, N., PENG, S.G. and QUENEZ, M. C. (1997) Backward stochastic differential equations 
in finance, Math. Finance 7, 1-71. 

[13] Ji, S.L. and Yang, S.Z. (2012) An optimal control problem for functional forward-backward stochastic 
systems and related Path- dependent HJB equations, arxiv.org/abs/1204.6543. 

[14] PARDOUX, E. and PENG, S.G. (1990) Adapted solution of a backward stochastic differential equa- 
tion, Systems Control Lett. 14, No. 1-2, 55-61. 

[15] PARDOUX, E. and PENG, S.G. (1992) Backward stochastic differential equations and quasilinear 
parabolic partial differential equations. Stochastic partial differential equations and their applications, 
Proc. IFIP Int. Conf., Charlotte/NC (USA) 1991, Lect. Notes Control Inf. Sci. 176, 200-217. 

[16] PARDOUX, E. and TANG, S.J. (1999) Forward-backward stochastic differential equations and quasi- 
linear parabolic PDEs, Prob. Theory Relat. Fields 114, 123-150. 

[17] PENG, S.G. (1990) A general stochastic maximum principle for optimal control problems, SIAM J. 
Control Optim. 28, 966-979. 



20 



[18] PENG, S.G. (1991) Probabilistic interpretation for systems of quasilinear parabolic partial differential 
equation, Stochastic Reports 37, 61-74. 

[19] PENG, S.G. (1992) A generalized dynamic programming principle and Hamilton-Jacobi-Bellman 
equation, Stochastics and Stochastics Reports. 38, 119-134. 

[20] PENG, S.G. (1997) Backward stochastic differential equations- stochastic optimization theory and 
viscosity solutions of HJB equations, in Topics on stochastic analysis, YAN, J. A., PENG, S.G., 
FANG, S.Z. and WU, L.M. Ch.2, Science Press. Beijing. 85-138 (in Chinese). 

[21] PENG, S.G. Note on Viscosity Solution of Path- Dependent PDE and G- Martingales, 
arxiv.org/ abs / 1 106. 1 144vl . 

[22] PENG, S.G. and WANG F.L. (2011) BSDE, Path- dependent PDE and Nonlinear Feynman-Kac 
Formula, arxiv. org / abs / 1 1 08.431 7. 

[23] WU, Z. and YU, ZY. (2008) Dynamic programming principle for one kind of stochastic recursive 
optimal control problem and Hamilton-Jacobi-Bellman equation, SIAM J. CONTROL OPTIM. 47(5), 
2616-2641. 

[24] YONG J. and ZHOU XY. Stochastic controls: Hamiltonian systems and HJB equations. Springer- 
Verlag, New York (1999). 



21 



